🕷️️ Job Radar • SCRAPING

freelancer.com 2026-04-17 🟠

🔹 Large-Scale Course Data Scraping from Udemy, Coursera, and YouTube
👤 Client: 🇮🇳 Pune, India Member since 2026-04-16
💰 Price: $12 Average bid
🚩 Problem: Collect a large dataset of online courses and tutorials for research and analytics.
📦 Existing: Not specified

Specifications:

[Target] - Collect approximately 200,000 course/tutorial records from Udemy, Coursera, and YouTube.
[Method] - Use Python with BeautifulSoup, Selenium, or Scrapy for web scraping. Handle pagination, dynamic loading, and scrolling as needed.
[UI/UX] - Not applicable
[Stack] - Python, BeautifulSoup, Selenium, Scrapy
[Security] - Ensure compliance with platform terms of service; avoid legal issues by respecting rate limits and user agreements.
[Format] - Deliver dataset in CSV, Excel, or JSON format. Ensure 200,000 unique entries.

Workflow:

1. Define scraping scope and target URLs for Udemy, Coursera, and YouTube.
2. Develop a Python script using BeautifulSoup, Selenium, or Scrapy to scrape course/tutorial data including title, URL, platform name, category (Technical/Non-Technical), and paid/free indicator.
3. Implement pagination handling, dynamic loading, and scrolling as necessary.
4. Clean and structure the scraped data to avoid duplicates.
5. Export the final dataset in CSV, Excel, or JSON format with 200,000 unique entries.